Diversity-induced resonance in a system of globally coupled linear oscillators 
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The purpose of this paper to analyze in some detail the arguably simplest case of diversity- 
induced reseonance: that of a system of globally-coupled linear oscillators subjected to a periodic 
forcing. Diversity appears as the parameters characterizing each oscillator, namely its mass, internal 
frequency and damping coefficient are drawn from a probability distribution. The main ingredients 
for the diversity-induced-resonance phenomenon are present in this system as the oscillators display 
a variability in the individual responses but are induced, by the coupling, to synchronize their 
responses. A steady state solution for this model is obtained. We also determine the conditions 
under which it is possible to find a resonance effect. 



INTRODUCTION 

Many situations of interest can be modeled by a forced 
system whose output depends on some external forcing. 
Examples can be found in physics, ecology, chemistry, 
economics, biology and other sciences. For instance, the 
response of a neuron depends strongly on the input cur- 
rents, such that a pulse is produced only when the total 
input surpasses some threshold value. In some cases, 
the system is under the action of a periodic forcing and 
the response can be quantified by the amplitude of the 
periodic oscillations that the system performs at the fre- 
quency of the input. A classic example is that of a forced 
linear pendulum with damping terms. It is known that 
the response is optimal -the amplitude of the pendulum 
oscilations reaches a maximum- when the natural fre- 
quency of the oscillator matches that of the external forc- 
ing. In the case of non-linear oscillators a more complex 
behavior can appear and the region in which the system 
synchronizes to the external forcing might depend on the 
values of the parameters characterizing the system [1]. 

A few decades ago, a particularly interesting resonance 
effect induced by random terms in the dynamics was dis- 
covered. This important phenomenon, known as Stochas- 
tic Resonance [l,!^, shows that disorder, in the form of 
dynamical noise, can improve the response of a non-linear 
dynamical system to an external stimulus. This counter- 
intuitive effect of noise, first proposed to explain the ob- 
served periodicity of ice-ages, has since been extended to 
a large variety of systems, including bistable, excitable, 
chaotic systems 0, H[. The main result is that, under 
some very general conditions, the right amount of noise 
can help achieve a maximal synchronization of the dy- 
namical variables in response to an external forcing. This 
phenomenon results in a resonance curve where some ad- 
equate measure R of the system's response shows a maxi- 
mum for a particular value of the noise intensity D, with 
the response diminishing for smaller or larger D. The 
generic mechanism for the resonance is the matching of 
some characteristic time scale of the forcing (e.g. the pe- 
riod) with a characteristic time induced by the noise (e.g. 



the Kramers time for jumping over a potential barrier). 
Examples of this phenomenon occur in a wide variety 
of fields, including paleoclimatology, chemical reactions, 
neuronal systems, lasers and biological environments. 

A different mechanism that also profits from disorder 
to enhance the response to an external stimulus has been 
shown in reference |6j]. The basic idea is to take advan- 
tage of the diversity that appears in an extended system 
composed of many constituents. It is obvious that in 
many systems in biology, physics and economics, it is 
necessary to take into account the fact that the underly- 
ing constituents are not identical. The usual assumption 
that the constituents are identical is only an approxima- 
tion which is usually taken for reasons of mathematical 
simplicity. This diversity of the elements can have many 
different origins: heterogeneity in a parameter (equiva- 
lent to quenched noise), heterogeneity in the network of 
connectivities or in their strength, etc. In fact, one of 
the main points in p is to argue that any source of dis- 
order is able, under the right circumstances, to enhance 
the response to the forcing. 

More precisely, the authors of reference [6[ considered 
a system composed of N coupled bistable -double well 
potential- units, subjected to an external weak periodic 
signal. Diversity is introduced as the variability of a set 
of parameters a&, k = 1, . . . , N that control the relative 
stability of each bistable state of the potential. If the 
parameter a& is equal to zero for unit k the two potential 
wells have the same depth. For a& > the well in the 
right is deeper than the one on the left and vice-versa 
for ak < 0. A weak periodic signal acts upon all the 
units. By weak it is meant that the signal can not induce 
jumps between the two potential wells in the symmetric 
case ak = 0. It is assumed that the a^s follow a dis- 
tribution of average value (ak) =0 and variance a 2 . It 
is further assumed that the units are positively coupled 
and, hence, they all tend to stay in the same well. The 
mechanism for resonance is as follows: If a = 0, the sig- 
nal is subthreshold for all units and the system responds 
globally with just small oscillations; as a increases some 
of the units are able to follow the signal during the half- 
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period in which the signal goes in the direction of the 
preferred well; in the other half of the period, a different 
set of units follows the signal. The units which follow the 
signal pull the other units, to whom they are attractively 
coupled, and the collective effect is that a significant frac- 
tion of the units is able to respond to the external forcing. 
If the diversity a is too large, the units are very different 
from each other and some of them offer a strong resis- 
tance against following the signal. Resistance which can 
not be overcome by the coupling between units. 

Complementary to this microscopic mechanism for res- 
onance in which one analyzes the behavior of individual 
units, it is also possible to give a macroscopic explanation 
in which one focuses only on the behavior of the global 
variable that represents the system (usually, simply the 
sum of all individual variables). The diversity induces a 
degradation in the global order that results in the low- 
ering of the effective potential barrier separating the two 
stable states of the collective system. The barrier can 
then be more easily overcome by the external forcing [7]. 
The collective effect can then be understood as the result 
of the degradation of order induced by diversity. What 
is worth noticing is that any source of disorder would 
lead to a similar effect. This explanation sheds new light 
on the phenomenon of stochastic resonance in extended 
systems in which the disorder is induced by noise. In 
other cases, it is the disorder induced by the competitions 
in the network of connectivities between the units that 
induces disorder and drives the resonance [To|. As argued 
in reference the proposed mechanism is generic and 
might appear in a large variety of systems of interest in 
many different fields. For instance, the role of the hetero- 
geneous complex network topology in the amplification 
of external signals has also been addressed in and a 
recent work [12[ has shown that structural diversity en- 
hances the cellular ability to detect extracellular weak 
signals. The interplay between noise and diversity in an 
ensemble of coupled bistable FitzHugh-Nagumo elements 
subject to weak signal has been considered in [l3j]. Refer- 
ence [14] reveals that the general mechanism for collective 
synchronized firing in excitable systems arises from the 
degradation of order. The ability of diversity to enhance 
coherent behavior in networks with attractive and repul- 
sive excitable systems has been addressed in [Til, H, ITt( | 
and the combined effects of noise and variability in the 
synchronization of neural elements has been studied in 

m 

Although surprising at first, the idea that diversity in 
the units forming a large system can improve the response 
to an external signal is not against our experience [19]. 
For example, a society can respond to changes in the 
economy if it is formed by diverse agents, such that a 
fraction of the population is successful at different times. 
It is the positive interaction between the agents that can 
cause the whole population to respond successfully to the 
changing environment. 



The mechanism proposed for resonance is very simple 
and requires only generic ingredients. It is the purpose of 
this paper to analyze in some detail the arguably simplest 
case: that of a system of globally-coupled linear oscilla- 
tors subjected to a periodic forcing. Diversity appears 
as the parameters characterizing each oscillator, namely 
its mass, internal frequency and damping coefficient are 
drawn from a probability distribution. The main ingredi- 
ents for the diversity-induced resonance phenomenon are 
present in this system as the oscillators display a vari- 
ability in the individual responses but are induced, by the 
coupling, to synchronize their responses. The paper is or- 
ganized as follows: in the next section we will define pre- 
cisely the model and parameters and solve the equations 
of motion for the steady state. Once the main formulas 
are established, in section we will analyze under which 
conditions it is possible to find the resonance-effect. Fi- 
nally, in section we will end with a brief conclusion and 
outlook. 

LINEAR MODEL AND SOLUTION 

We consider a system of N globally coupled linear os- 
cillators with canonical variables (xk,Pk), k = 1,...,N, 
whose evolution is given by: 



Pk = ~—Pk - m k ujlx k + y^jxj - x k ) + Fcos(Ot), 

(1) 

or the single equivalent equation: 

N 

m k Xk = -7fcX fe - mkwjxk + — ^(xj - %k) + F cos(Ot). 

i=i 

(2) 

Here, rrik, jk and uok are, respectively, the mass, the 
damping coefficient and the natural frequency of oscil- 
lator k. rrik and jk are assumed to take only positive 
values. The external forcing F cos(Qt) acts upon all os- 
cillators. The all-to-all coupling term represents the ten- 
dency of all oscillators to act synchronously when the 
coupling coefficient k is positive. This term can also be 
written as: 

N 

ft ^2( X 3 ~ X k) = ^(X - X k ), (3) 
J = l 

where 

1 N 

*W = jV Z>'W ( 4 ) 

is the collective (or mean- field) variable. In the absence 
of forcing, F = 0, the dynamical system can be written 
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as relaxational dynamics [20] in a Hamiltonian 



N 



k=l 



in the form 



A. 

2m k 



Xk 

Pk 



~-m k u 2 k x 2 k 



N 



27V 



Xk) 2 



1 

~lk 



dH 

dx k 

an 

dPk 



(5) 



(6) 



Since the matrix 



1 

~lk 



can be split in symmet 
\ , / 1 



ric and antisymmetric matrices , n% , , , , 

and the symmetric part does not have positive eigenval- 
ues, the Hamiltonian H is a Lyapunov function of the 
dynamics [13]. It is easy to show directly that the energy 
decreases steadily: 



dH _ A 
~dt ~ ^ 



k=i 



dH 

dpk 



Pk 



dH 

dx k 



x k 



N 

g^O, ,7) 



hence the system relaxes to the minimum of H: p k = 
x k = 0, Vfc. The external forcing F cos(Qt) injects energy 
and produces a final state in which the variables (x kl p k ) 
oscillate in time with the frequency Q. Introducing the 
complex notation z k = x k + ifl~ 1 x k we get: 

m k z k = -7feife - m k ijj\z k + k(z - z k ) + Fe~ l9J 



Zk) 



(8) 



a k \e^ k , a 



with z = TV -1 J2 k=1 z k . After a transient time, the vari- 
ables z k (t) tend to z k (t) = a k e~ int with a& 
set of (complex) constants obtained as: 

F 



na 



CLk 



m k {uol - Q 2 ) + 

Those values must satisfy the self-consistent relation a 
=1 a k . Straightforward algebra leads to: 

FG 



(9) 



G 



Gk, 



1-kG' 



(10) 



where G k and G are defined as: 



G 



1 * 



fe=i 



m k (u 2 k 



n 2 ) 



(11) 

In the previous equations, note that coupling acts in 
two different ways: in the /^-independent prefactor, i.e. 
as a collective effect acting equally on all the oscillators, 
and as the ^-dependent second factor, which can be un- 
derstood as a renormalization of the resonant frequency 
of the oscillator k from uo k to Cb kl with m k uo 2 = m k uo 2j rn. 

A standard measure |4| of the global response R is the 

modulus of the mean variable z normalized to the exter- 

\z\ 2 

nal input R = — — , or 

F 1 



R 



G 



\-kG 



(12) 



This is more easily computed in terms of the real and 
imaginary parts of G k = A k + iB k: as: 



with: 



(Bk) 



R = 



N 



(A k ) 2 + {B k y 



l-2 K (A k ) + K 2 ((A k ) 2 + (B k } 2 ) 



(13) 



m k {u\ - Q 2 ) + k 



k=i 



N 



(m k (u 2 



fi 2 ) + «) +7** 



(14) 



1 „ 



N 



B k 



k=l 



(15) 

The expressions above are valid whatever the value of 
the number of oscillators N. In the case that the number 
of oscillators is very large, the sums can be replaced by 
averages with respect to a probability distribution f(T) 
in the space of parameters T k = (m k ,uj k ,~f k ): 



(S(T k )) = / dTS(T)f(T), (16) 



k=l 

being f(T) the probability density function of the set of 
parameters T k and S(T) any function depending on those 
parameters. 

After a transient time, the k = 1, . . . , N linear oscilla- 
tors z k = |afc|e*( _fi * + ^ fe ) oscillate in time with a frequency 
Q and phase <p k . If all parameters (m kl uo k ^ k ) are iden- 
tical, the modulus \a k \ and the phases <p k are identical 
for all oscillators. If any of the parameters in the set 
{m k ,uj k ,~f k ) varies from one oscillator to another, there 
is a dispersion in amplitudes and phases, see figure [6l 

There are several possible ways to quantify this disper- 
sion in the individual dynamical output. A convenient 
one is to use the variance of the variables z k normalized 
by the average value of the modulus squared: 



2r , N-^ k= ^k-z\ 



\Zk - z\ 2 ) 

<M 2 > ' 



(17) 



In the case of no dispersion, cr^[^] = 0; because of the 
normalization, the maximum value is cr 2 ^] = 1. We 
define a measure of order as: 



P = yJl-(Tl[z k ] = 



(18) 



The definition is such that p = 1 in the case of no disper- 
sion, a 2 [z k ] = and decreases to p = as the dispersion 
increases. Moreover, in the case that all units oscillate 
with the same amplitude \z k \, the definition reduces to 
the famous order parameter Kuramoto introduced in his 
studies of phase synchronization[2lj. Within the context 
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of this work we will denote by p^ the Kuramoto order 
parameter: 



1 N 

Np 1 ' 
k=i 



\(e* k )\ 



(19) 



We also introduce a measure of the dispersion in the am- 
plitude of the oscillators, p\ z \ as: 



P\z\ 



(20) 



It reaches the maximum value p\ z \ = 1 in the case of no 
dispersion in the modulus of the oscillators and decreases 
towards zero as the dispersion increases. 

The measure of order p can be computed as: 



1 (A k ) 2 + (B k ) 2 



the Kuramoto order parameter can be computed as: 



with 



ak 



P4> = VK> 2 + (fa) 2 , 

m k (u>l - fi 2 ) + k 
y/ \m k (LV 2 k - ft 2 ) + k) 2 + 7 2 ft 2 ' 

Tfc^ . 

y/( mk (u 2 -W)+ K ) 2 +1 tW 



(21) 

(22) 

(23) 
(24) 



and, finally, the measure in the dispersion of the modulus 
of the oscillators can be written as: 



P\z\ 



v^Tb 2 



(25) 



RESULTS 

Most of the results in this section (except in one case 
at the end of the section) consider that the diversity only 
appears in the natural frequencies uo k of the oscillators. 
These are drawn from a Gaussian distribution of mean ujq 
and variance a 2 . Since a is a measure of the dispersion 
in the frequencies, it will be considered as the measure of 
the diversity. For most of the section, and in order not to 
introduce too many variable factors in the analysis, we 
will take the masses, m^, and damping constants, 7^, to 
have the same values in all the units. 

The main result of this paper is summarized in figure 
[D where we plot the global system's response R, as given 
by Eq. ([12]) , versus the diversity parameter a for different 
values of the frequency Q of the external forcing. It is 
apparent from this figure that, for values of Q smaller 
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FIG. 1: Plot of the response R, Eg. ([12)) . versus the diversity 
parameter a for different values of the frequency Q of the 
external forcing. The natural frequencies Uk of the oscillators 
have been drawn from a Gaussian distribution of mean uo = 1 
and variance a 2 . Other parameters are: rrik — 1, Jk — 0.1, 



than the average value cjo, the response increases and 
goes through a maximum -a resonance- as the diversity 
parameter increases. In fact, as can be seen in the figure, 
for fl close to cjo, there can be two peaks in the resonance. 
Those peaks merge into a single one, with decreasing 
height, as Q decreases. The regions of existence of the 
resonance can be better observed in a two dimensional 
plot of the response as a function of the diversity a and 
the frequency fi, see figure O Note that, according to this 
figure, the resonant frequency moves with a to regions 
where there was no strong response in the absence of 
disorder. 

The microscopic argument to explain the resonance is 
very simple: When a = all oscillators have the same 
frequency uoq. The response is optimal for loq = Q. If 
uoq 7^ Q the oscillators are not at the optimal value. Then, 
as a increases, some oscillators will have frequencies close 
to Q and will tend to have a larger response. It is those os- 
cillators that, through the coupling term, pull the others 
and produce the large response of the collective variable 
x. 

As argued in [y] , the increase in the response is accom- 
panied by a decrease in the order (but not necessarily 
vice- versa) . This is clearly illustrated in figure [3] where 
we plot the measure of order p, as defined in Eq. ([T8]) . as a 
function of the diversity parameter a for different values 
of the frequency Q of the external forcing. As shown in 
figure [4j the Kuramoto order parameter stays close to the 
value p^ = 1 for values of a where the resonance appears 
but the dispersion in the amplitude, as measured by p\ z \, 
increases with a, see figured This shows that the oscilla- 
tors lose their order through a dispersion of the modulus 
of their amplitude. In other words, they follow the ex- 
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FIG. 2: Two-dimensional plot of the response R versus the 
frequency of the external forcing Q and the rms a of the Gaus- 
sian distribution (mean value uo = 1) of the internal frequen- 
cies Uk- Other parameters are rrik = 1 and: jk =0.1, k = 1.0 
(top left); 7 = 0.1, k = 0.5 (top right); 7 = 0.1, k = 0.1 
(bottom left); 7 = 1.0, k = 0.1 (bottom right). 



finish by plotting in the final figure [10] the resonance ef- 
fect that appears when both the frequencies uok and the 
damping coefficients 7^ vary from one unit to the other. 
To maintain posit ivity of the damping coefficients, we 
have chosen a log-normal distribution for both param- 
eters. More concretely, we have taken uok = uJo^k and 
7fe = 7o77c> where Tfc follows a log- normal distribution of 
mean 1 and rms a. It is clear that a strong resonance 
effect appears as a function of the diversity a (measured 
now as the relative, normalized to the mean value, rms 
of the log- normal distributions). Note that, for this par- 
ticular set of parameter values, the maximal response is 
much larger than the maximum response obtained when 
the external frequency equals the mean value ujq = ^- 
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n=i.i 

f]=1.0 
fi = 0.9 
fi = 0.8 
fi = 0.7 



0.0 [ 



ternal signal with similar phases, but with different am- 
plitudes. Figure [6] helps to demonstrate this effect. We 
plot in this figure the trajectories in the complex plane 
z, equivalent to the phase space (x,x). When a = 0, 
all units have the same amplitude and phase and oscil- 
late with the external frequency Q. As a increases, the 
average value z oscillates with a larger amplitude (and 
always with the frequency Q of the external forcing) and 
the individual units oscillate with nearly the same phase 
but with different amplitudes, producing the dispersion 
that can be seen in the figure. 

Coupling is essential for the resonance effect. In fig- 
ure we plot the phase space in the case of absence of 
coupling for the same set of parameters as those of fig- 
ure El As can be seen in this figure, the response always 
decreases with increasing the diversity. What it is some- 
what surprising is that a too large coupling also dimin- 
ishes the response. This is observed in the surface plot of 
figure [8j The decrease of the response for large coupling 
is also evident in figure [9] where we use the same value of 
the frequency as in figures [6] and 

So far, we have focused our attention on the case of 
variability in the distribution of internal frequencies ujk- 
It is not the intention of this paper to overwhelm the 
reader with many figures covering the many possibilities 
of dispersion in the different parameters. We want to 



FIG. 3: Plot of the measure of order p, Eq. (fT8]h characterizing 
the dispersion of the position of the oscillators, as a function of 
the diversity parameter a for different values of the frequency 
Q of the external forcing. The natural frequencies ujk of the 
oscillators have been drawn from a Gaussian distribution of 
mean c^o = 1 and variance a 2 . Other parameters are: mk = 1, 
7/e 0.1, k = 1. 



CONCLUSION 

In this paper we have studied an ensemble of globally 
coupled linear oscillators subjected to periodic forcing. 
Diversity appears as each unit of the ensemble has differ- 
ent characteristic parameters, although we have focused 
our main attention on the case in which only the natu- 
ral frequencies vary from one oscillator to another. Our 
intention has been to analyse with some detail an ex- 
actly solvable model that displays the phenomenon of 
diversity-induced resonance, namely, that the global re- 
sponse to the external forcing is enhanced by the presence 
of diversity in the units. We have been able to give ex- 
plicit expressions for the global response and some mea- 
sures of the order in the positions, phases and modulus 
of the units of the ensemble. 
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FIG. 4: 

tors. 



Same as Fig (3] for the Kuramoto order parameter p^, 
characterizing the dispersion in phase of the oscilla- 




FIG. 5: Same as Fig (3] for p\ z \, Ea ([19[) . characterizing the 
dispersion in modulus of the oscillators. 



The details of the phenomenon bear some similari- 
ties, but also some differences, with previous studies in 
more complicated systems. The main microscopic mech- 
anism is as follows: In the no-diversity case, all units 
have the same natural frequency, which is different from 
the frequency of the external forcing. As the diversity in 
frequencies increases, a fraction of the units have a fre- 
quency that matches that of the external forcing and are 
then resonant with it. Those units are able, through the 
coupling terms, to pull the other units and the global, 
average, variable is able to display large amplitude os- 
cillations. As the diversity increases even further, the 
difference between the units increases. Some of them 
have then a frequency too far away from the external 
frequency and tend to follow the forcing with a small 
amplitude, hence diminishing the global response. The 
main difference with the mechanism analyzed in double- 
well systems (6) is that, as described in the introduction, 
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FIG. 6: Phase space Zk = for different values of 

the diversity parameter a. The natural frequencies uok of the 
oscillators have been drawn from a Gaussian distribution of 
mean c^o = 1 and variance a 2 . Other parameters are: ink — 1, 
7& = 0.1, k = 1, O = 0.9. The solid dot is the position of 
the mean value z of N = 10000 oscillators, while the crosses 
indicate the position of 20 of those oscillators. The circle has 
the radius of the modulus of z. All points rotate clockwise 
with the circular frequency Q of the external forcing. 



in those systems the units that are able to follow the 
forcing vary from time to time. That model is thus more 
useful to model situations of a changing environment. 

The analytical solution of the linear equations of mo- 
tion allows a full analysis of the problem. As implied 
in reference [6[, see also |7j, the enhancement in the re- 
sponse appears together with a decrease in the macro- 
scopic order. We have introduced appropriate measures 
of this order in terms of the dispersion in the locations 
of the oscillators in phase space. Those measures show 
that the loss of order is mainly in the amplitude of the 
oscillations whereas the phases show a much smaller dis- 
persion. We are currently interested in studying which 
of these features remain when considering the enhance- 
ment in the response of non-linear ocillators induced by 
diversity. The results wil be reported elsewhere. 
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FIG. 8: Two-dimensional plot of the response R versus the 
coupling k and the rms a of the Gaussian distribution (mean 
value uq = 1) of the internal frequencies Uk- Other parame- 
ters are rrik = 1, Jk = 0.1 and: Q = 0.8 (top left), = 0.9 
(top right), Q = 1.0 (bottom left), Q = 1.1 (bottom right). 



FIG. 7: Same as figure [6] in the no coupling case, k = 0. 
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FIG. 10: Plot of the response R, Ea. ([T2]) . versus the diversity 
parameter a for different values of the frequency £1 of the 
external forcing. The natural frequencies Uk and the damping 
parameters jk have been drawn from a common lognormal 
distribution of mean values uo = 1, 70 = 0.1, and rms a cjo, 
(770, respectively (see the text for details). Other parameters 
are: vfik = 1, ft = 0.2. 



